Rat hippocampal CA1 region represents learning-related action and reward events with shorter latency than the lateral entorhinal cortex.

The hippocampus and entorhinal cortex are deeply involved in learning and memory. However, little is known how ongoing events are processed in the hippocampal-entorhinal circuit. By recording from head-fixed rats during action-reward learning, here we show that the action and reward events are represented differently in the hippocampal CA1 region and lateral entorhinal cortex (LEC). Although diverse task-related activities developed after learning in both CA1 and LEC, phasic activities related to action and reward events differed in the timing of behavioral event representation. CA1 represented action and reward events almost instantaneously, whereas the superficial and deep layers of the LEC showed a delayed representation of the same events. Interestingly, we also found that ramping activity towards spontaneous action was correlated with waiting time in both regions and exceeded that in the motor cortex. Such functional activities observed in the entorhinal-hippocampal circuits may play a crucial role for animals in utilizing ongoing information to dynamically optimize their behaviors.

Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys.

Despite being unpredictable and uncertain, reward environments often exhibit certain regularities, and animals navigating these environments try to detect and utilize such regularities to adapt their behavior. However, successful learning requires that animals also adjust to uncertainty associated with those regularities. Here, we analyzed choice data from two comparable dynamic foraging tasks in mice and monkeys to investigate mechanisms underlying adjustments to different types of uncertainty. In these tasks, animals selected between two choice options that delivered reward probabilistically, while baseline reward probabilities changed after a variable number (block) of trials without any cues to the animals. To measure adjustments in behavior, we applied multiple metrics based on information theory that quantify consistency in behavior, and fit choice data using reinforcement learning models. We found that in both species, learning and choice were affected by uncertainty about reward outcomes (in terms of determining the better option) and by expectation about when the environment may change. However, these effects were mediated through different mechanisms. First, more uncertainty about the better option resulted in slower learning and forgetting in mice, whereas it had no significant effect in monkeys. Second, expectation of block switches accompanied slower learning, faster forgetting, and increased stochasticity in choice in mice, whereas it only reduced learning rates in monkeys. Overall, while demonstrating the usefulness of metrics based on information theory in examining adaptive behavior, our study provides evidence for multiple types of adjustments in learning and choice behavior according to uncertainty in the reward environment.

Hippocampal-medial entorhinal circuit is differently organized along the dorsoventral axis in rodents.

The general understanding of hippocampal circuits is that the hippocampus and the entorhinal cortex (EC) are topographically connected through parallel identical circuits along the dorsoventral axis. Our anterograde tracing and in vitro electrophysiology data, however, show a markedly different dorsoventral organization of the hippocampal projection to the medial EC (MEC). While dorsal hippocampal projections are confined to the dorsal MEC, ventral hippocampal projections innervate both dorsal and ventral MEC. Further, whereas the dorsal hippocampus preferentially targets layer Vb (LVb) neurons, the ventral hippocampus mainly targets cells in layer Va (LVa). This connectivity scheme differs from hippocampal projections to the lateral EC, which are topographically organized along the dorsoventral axis. As LVa neurons project to telencephalic structures, our findings indicate that the ventral hippocampus regulates LVa-mediated entorhinal-neocortical output from both dorsal and ventral MEC. Overall, the marked dorsoventral differences in hippocampal-entorhinal connectivity impose important constraints on signal flow in hippocampal-neocortical circuits.

Depression induced by low-frequency repetitive transcranial magnetic stimulation to ventral medial frontal cortex in monkeys.

The medial frontal cortex (MFC), especially its ventral part, has long been of great interest with respect to the pathology of mood disorders. A number of human brain imaging studies have demonstrated the abnormalities of this brain region in patients with mood disorders, however, whether it is critically and causally involved in the pathogenesis of such disorders remains to be fully elucidated. In this study, we examined how the suppression of neural activity in the ventral region of the MFC (vMFC) affects the behavioral and physiological states of monkeys by using repetitive transcranial magnetic stimulation (rTMS). By using low-frequency rTMS (LF-rTMS) as an inhibitory intervention, we found that LF-rTMS targeting the vMFC temporarily induced a depression-like state in monkeys, which was characterized by a reduced movement activity level, impaired sociability, and decreased motivation level, as well as increased plasma cortisol level. On the other hand, no such significant changes in behavioral and physiological states were observed when targeting the other MFC regions, dorsal or posterior. We further found that the administration of an antidepressant agent, ketamine, ameliorated the abnormal behavioral and physiological states induced by the LF-rTMS intervention. These findings causally indicate the involvement of the vMFC in the regulation of mood and the validity of the LF-rTMS-induced dysfunction of the vMFC as a nonhuman primate model of depression.

Monkey Prefrontal Single-Unit Activity Reflecting Category-Based Logical Thinking Process and Its Neural Network Model.

Category-based thinking is a fundamental form of logical thinking. Here, we aimed to investigate its neural process at the local circuit level in the prefrontal cortex (PFC). We recorded single-unit PFC activity while male monkeys (Macaca fuscata) performed a task in which the category and rule were prerequisites of logical thinking and the outcome contingency was its consequence. Different groups of neurons coded a single type of information discretely or multiple types in a transitional form. Results of time-by-time analysis of neuronal activity suggest an information flow from category-coding and rule-coding neurons to transitional intermediate neurons, and then to contingency-coding neurons. Category-coding, rule-coding, and contingency-coding neurons showed stable coding of information, whereas intermediate neurons showed dynamic coding, as if it integrated category and rule to derive contingency. A similar process was confirmed by using a spiking neural network model that consisted of subnetworks coding category and rule on the input layer and those coding contingency on the output layer, with a subnetwork for integration in the intermediate layer. These results suggest that category-based logical thinking is realized in the PFC by separated neural populations organized for working in a feedforward manner.SIGNIFICANCE STATEMENT To elucidate the neural process for logical thinking, we combined an in-depth analysis of single-unit activity data with a biologically plausible computational model. Results of time-by-time analysis of prefrontal neuronal activity suggest an information flow from category-coding and rule-coding neurons to transitional intermediate neurons, and then to contingency-coding neurons. Category-coding, rule-coding, and contingency-coding neurons showed stable coding, whereas intermediate neurons showed dynamic coding, as if they integrated category and rule to derive contingency. A spiking neural network model reproduced similar temporal changes of information as the recorded neuronal data. Our results suggest that the prefrontal cortex (PFC) is critically involved in category-based thought process, and this process may be produced by separated neural populations organized for working in a feedforward manner.

Laminar Organization of the Entorhinal Cortex in Macaque Monkeys Based on Cell-Type-Specific Markers and Connectivity.

The entorhinal cortex (EC) is a major gateway between the hippocampus and telencephalic structures, and plays a critical role in memory and navigation. Through the use of various molecular markers and genetic tools, neuron types constituting EC are well studied in rodents, and their layer-dependent distributions, connections, and functions have also been characterized. In primates, however, such cell-type-specific understandings are lagging. To bridge the gap between rodents and primates, here we provide the first cell-type-based global map of EC in macaque monkeys. The laminar organization of the monkey EC was systematically examined and compared with that of the rodent EC by using immunohistochemistry for molecular markers which have been well characterized in the rodent EC: reelin, calbindin, and Purkinje cell protein 4 (PCP4). We further employed retrograde neuron labeling from the nucleus accumbens and amygdala to identify the EC output layer. This cell-type-based approach enabled us to apply the latest laminar definition of rodent EC to monkeys. Based on the similarity of the laminar organization, the monkey EC can be divided into two subdivisions: rostral and caudal EC. These subdivisions likely correspond to the lateral and medial EC in rodents, respectively. In addition, we found an overall absence of a clear laminar arrangement of layer V neurons in the rostral EC, unlike rodents. The cell-type-based architectural map provided in this study will accelerate the application of genetic tools in monkeys for better understanding of the role of EC in memory and navigation.

Changes in beta and high-gamma power in resting-state electrocorticogram induced by repetitive transcranial magnetic stimulation of primary motor cortex in unanesthetized macaque monkeys.

Repetitive transcranial magnetic stimulation (rTMS) is now widely used as a means of neuromodulation, but the details of the mechanisms by which rTMS works remain unclarified. As a step forward to unveiling the neural phenomena occurring underneath the TMS coil, we conducted an electrophysiological study using awake and unanesthetized monkeys with subdural electrocorticogram (ECoG) electrodes implanted over the primary motor cortex (MI). We evaluated the effects of low-frequency (1 Hz) and high-frequency (10 Hz) rTMS on the resting-state ECoG signals in the stimulated MI, as well as the motor evoked potentials (MEPs) in the contralateral hand. Following the 1-Hz rTMS application, the ECoG beta band power and the MEP amplitude were significantly decreased. Following the 10-Hz rTMS application, the ECoG high-gamma power and the MEP amplitude significantly increased. Given that beta and high-gamma activities in the ECoG reflect the synchronous firing and the firing frequency of cell assemblies, respectively, in local neural circuits, these results suggest that low-frequency rTMS inhibits neural activity by desynchronizing the firing activity of local circuits, whereas high-frequency rTMS facilitates neural activity by increasing the firing rate of cell assemblies in the local circuits.

Entorhinal Layer II Calbindin-Expressing Neurons Originate Widespread Telencephalic and Intrinsic Projections.

In the present study we provide the first systematic and quantitative hodological study of the calbindin-expressing (CB+) principal neurons in layer II of the entorhinal cortex and compared the respective projections of the lateral and medial subdivisions of the entorhinal cortex. Using elaborate quantitative retrograde tracing, complemented by anterograde tracing, we report that the layer II CB+ population comprises neurons with diverse, mainly excitatory projections. At least half of them originate local intrinsic and commissural projections which distribute mainly to layer I and II. We further show that long-range CB+ projections from the two entorhinal subdivisions differ substantially in that MEC projections mainly target field CA1 of the hippocampus, whereas LEC CB+ projections distribute much more widely to a substantial number of known forebrain targets. This connectional difference between the CB+ populations in LEC and MEC is reminiscent of the overall projection pattern of the two entorhinal subdivisions.

Primate prefrontal neurons signal economic risk derived from the statistics of recent reward experience.

Risk derives from the variation of rewards and governs economic decisions, yet how the brain calculates risk from the frequency of experienced events, rather than from explicit risk-descriptive cues, remains unclear. Here, we investigated whether neurons in dorsolateral prefrontal cortex process risk derived from reward experience. Monkeys performed in a probabilistic choice task in which the statistical variance of experienced rewards evolved continually. During these choices, prefrontal neurons signaled the reward-variance associated with specific objects ('object risk') or actions ('action risk'). Crucially, risk was not derived from explicit, risk-descriptive cues but calculated internally from the variance of recently experienced rewards. Support-vector-machine decoding demonstrated accurate neuronal risk discrimination. Within trials, neuronal signals transitioned from experienced reward to risk (risk updating) and from risk to upcoming choice (choice computation). Thus, prefrontal neurons encode the statistical variance of recently experienced rewards, complying with formal decision variables of object risk and action risk.

Behavioral evidence for the use of functional categories during group reversal task performance in monkeys.

A functional category is a set of stimuli that are regarded as equivalent independently of their physical properties and elicit the same behavioral responses. Major psychological theories suggest the ability to form and utilize functional categories as a basis of higher cognition that markedly increases behavioral flexibility. Vaughan claimed the category use in pigeons on the basis of partition, a mathematical criterion for equivalence, however, there have been some criticisms that the evidence he showed was insufficient. In this study, by using a group reversal task, a procedure originally used by Vaughan, we aimed to gather further evidence to prove the category use in animals. Macaque monkeys, which served as subjects in our study, could efficiently perform the task not only with familiar stimulus sets as Vaughan demonstrated but also with novel sets, and furthermore the task performance was stable even when the number of stimuli in a set was increased, which we consider as further evidence for the category use in animals. In addition, by varying the timing of the reversal, we found that a category formation takes place soon after encountering new stimuli, i.e. in a few blocks of trial after a novel stimulus set was introduced.

Intrinsic Projections of Layer Vb Neurons to Layers Va, III, and II in the Lateral and Medial Entorhinal Cortex of the Rat.

Layer V of the entorhinal cortex (EC) receives input from the hippocampus and originates main entorhinal outputs. The deep-sublayer Vb, immunopositive for the transcription factor Ctip2, is thought to be the main recipient of hippocampal projections, whereas the superficial-sublayer LVa, immunonegative for Ctip2, originates the main outputs of EC. This disrupts the proposed role of EC as mediating hippocampal-cortical interactions. With the use of specific (trans)synaptic tracing approaches, we report that, in medial entorhinal cortex, layer Vb neurons innervate neurons in layers Va, II, and III. A similar circuitry exists in the lateral entorhinal cortex. We conclude that EC-layer Vb neurons mediate two circuits in the hippocampus-memory system: (1) a hippocampal output circuit to telencephalic areas by projecting to layer Va and (2) a feedback projection, sending information back to the EC-hippocampal loop via neurons in layers II and III.

Sex Differences in Risk Preference and c-Fos Expression in Paraventricular Thalamic Nucleus of Rats During Gambling Task.

Different biological requirements between males and females may cause sex differences in decision preference when choosing between taking a risk to get a higher gain or taking a lower but sure gain. Several studies have tested this assumption in rats, however the conclusion remains controversial because the previous real-world like gambling tasks contained a learning component to track a global payoff of probabilistic outcome in addition to risk preference. Therefore, we modified a simple gambling task allowing us to exclude such learning effect, and investigated the sex difference in risk preference of rats and its neural basis. The task required water deprived rats to choose between a risky option which provided four drops of water or no reward at a 50% random chance vs. a sure option which provided predictable amount x (x = 1, 2, 3, 4). The amount and the risk were explicitly instructed so that different choice conditions could be tested trial by trial without re-learning of reward contingency. Although both sexes correctly chose the sure option with the same level of accuracy when the sure option provided the best offer (x = 4), they exhibited different choice performances when two options had the same expected value (x = 2). Males and females both preferred to take risky choices than sure choices (risk seeking), but males were more risk seeking than females. Outcome-history analysis of their choice pattern revealed that females reduced their risk preference after losing risky choices, whereas males did not. Rather, as losses continued, reaction time for subsequent risky choices got shorter in males. Given that significant sex difference features mainly emerged after negative experiences, male and female rats may evaluate an unsuccessful outcome of their decision in different manners. Furthermore, c-Fos expression in the paraventricular nucleus of the thalamus (PV) was higher in the gambling task than for the control task in males while c-fos levels did not differ in females. The present study provides a clear evidence of sex differences in risk preference in rats and suggests that the PV is a candidate region contributing to sex differences in risky decision making.

Ventrolateral Prefrontal Cortex Updates Chosen Value According to Choice Set Size.

Having chosen an item typically increases the subjective value of the chosen item, and people generally enjoy making choices from larger choice sets. However, having too many items to choose from can reduce the value of chosen items-for example, because of conflict or choice difficulty. In this study, we investigated the effects of choice set size on behavioral and neural value updating (revaluation) of the chosen item. In the scanner, participants selected items from choice sets of various sizes (one, two, four, or eight items). After they chose an item, participants rerated the chosen item, and we quantified revaluation by taking the difference of postchoice minus prechoice ratings. Revaluation of chosen items increased up to choice sets of four alternatives but then decreased again for items chosen from choice sets of eight alternatives, revealing both a linear and a quadratic effect of choice set size. At the time of postchoice rating, activation of the ventrolateral pFC (VLPFC) reflected the influence of choice set size on parametric revaluation, without significant relation to either prechoice or postchoice ratings tested separately. Additional analyses revealed relations of choice set size to anterior cingulate and insula activity during actual choice and increased coupling of both regions to revaluation-related VLPFC during postchoice rating. These data suggest that the VLPFC plays a central role in a network that relates choice set size to updating the value of chosen items and integrates choice overload with value-enhancing effects of larger choice sets.

Author Correction: A dynamic code for economic object valuation in prefrontal cortex neurons.

This corrects the article DOI: 10.1038/ncomms12554.

Increased transgene expression level of rabies virus vector for transsynaptic tracing.

Viral vectors that can infect neurons transsynaptically and can strongly express foreign genes are useful for investigating the organization of neural circuits. We previously developed a propagation-competent rabies virus (RV) vector based on a highly attenuated HEP-Flury strain (rHEP5.0-CVSG), which selectively infects neurons and propagates between synaptically connected neurons in a retrograde direction. Its relatively low level of transgene expression, however, makes immunostaining necessary to visualize the morphological features of infected neurons. To increase the transgene expression level of this RV vector, in this study we focused on two viral proteins: the large protein (L) and matrix protein (M). We first attempted to enhance the expression of L, which is a viral RNA polymerase, by deleting the extra transcription unit and shortening the intergenic region between the G and L genes. This viral vector (rHEP5.0-GctL) showed increased transgene expression level with efficient transsynaptic transport. We next constructed an RV vector with a rearranged gene order (rHEP5.0-GML) with the aim to suppress the expression of M, which plays a regulatory role in virus RNA synthesis. Although this vector showed high transgene expression level, the efficiency of transsynaptic transport was low. To further evaluate the usability of rHEP5.0-GctL as a transsynaptic tracer, we inserted a fluorescent timer as a transgene, which changes the color of its fluorescence from blue to red over time. This viral vector enabled us the differentiation of primary infected neurons from secondary infected neurons in terms of the fluorescence wavelength. We expect this propagation-competent RV vector to be useful for elucidating the complex organization of the central nervous system.

Robust, highly customizable, and economical multi-channel electrode for chronic multi-unit recording in behaving animals.

Multi-unit recording has been one of the most widely used techniques to investigate the correlation between multiple neuronal activities and behavior. However, a common problem of currently used multi-channel electrodes is their physical weakness. In this study, we developed a novel multi-channel electrode with sufficient physical strength to penetrate a thickened dura mater. This electrode consists of low-cost materials and is easily fabricated, and it enables recording without removing dura mater, thereby reducing the risk of inflammation, infection, or brain herniation. The low-cost multi-channel electrode developed in this study would be a useful tool for chronic recording in behaving animals.

Oral Administration of Methylphenidate (Ritalin) Affects Dopamine Release Differentially Between the Prefrontal Cortex and Striatum: A Microdialysis Study in the Monkey.

Methylphenidate (MPH; trade name Ritalin) is a widely used drug for the treatment of attention deficit hyperactivity disorder (ADHD) and is often used as a cognitive enhancer. Because MPH increases dopamine (DA) release by blocking the DA transporter in the human striatum, MPH is supposed to work on attention and cognition through a DA increase in the striatum. However, ADHD patients show impaired prefrontal cortex (PFC) function and MPH administration is associated with increased neural activity in the PFC. Although MPH is indicated to increase DA release in the rat PFC, there has been no study to examine MPH-induced DA changes in the human PFC because of technical difficulties associated with the low level of PFC DA receptors. Using the microdialysis technique, we examined the effects of oral administration of MPH on DA release in both the PFC and striatum in the monkey. We also tested the effect of MPH on cognitive task performance. As in human studies, in the striatum, both high and low doses of MPH induced consistent increases in DA release ∼30 min after their administrations. In the PFC, a consistent increase in DA release was observed 1 h after a high dose, but not low doses, of MPH. Low doses of MPH improved cognitive task performance, but a high dose of MPH made the monkey drowsy. Therefore, low-dose MPH-induced cognitive enhancement is supported by striatum DA increase.SIGNIFICANCE STATEMENT Methylphenidate (MPH) is a widely used drug for the treatment of attention deficit hyperactivity disorder and is often used as a cognitive enhancer. Although human positron emission tomography studies suggest that MPH works on attention and cognition through dopamine (DA) changes in the striatum, there has been no study to examine MPH-induced DA changes in the human prefrontal cortex (PFC). Using the microdialysis technique in monkeys, we found, for the first time, that low doses of MPH consistently increased DA release in the striatum but did not in the PFC. Cognitive enhancement effects of low doses of MPH are supposed to be supported by the striatum DA increase.

Comparative Overview of Visuospatial Working Memory in Monkeys and Rats.

Neural mechanisms of working memory, particularly its visuospatial aspect, have long been studied in non-human primates. On the other hand, rodents are becoming more important in systems neuroscience, as many of the innovative research methods have become available for them. There has been a question on whether primates and rodents have similar neural backgrounds for working memory. In this article, we carried out a comparative overview of the neural mechanisms of visuospatial working memory in monkeys and rats. In monkeys, a number of lesion studies indicate that the brain region most responsible for visuospatial working memory is the ventral dorsolateral prefrontal cortex (vDLPFC), as the performance in the standard tests for visuospatial working memory, such as delayed response and delayed alternation tasks, are impaired by lesions in this region. Single-unit studies revealed a characteristic firing pattern in neurons in this area, a sustained delay activity. Further studies indicated that the information maintained in the working memory, such as cue location and response direction in a delayed response, is coded in the sustained delay activity. In rats, an area comparable to the monkey vDLPFC was found to be the dorsal part of the medial prefrontal cortex (mPFC), as the delayed alternation in a T-maze is impaired by its lesion. Recently, the sustained delay activity similar to that found in monkeys has been found in the dorsal mPFC of rats performing the delayed response task. Furthermore, anatomical studies indicate that the vDLPFC in monkeys and the dorsal mPFC in rats have much in common, such as that they are both the major targets of parieto-frontal projections. Thus lines of evidence indicate that in both monkeys and rodents, the PFC plays a critical role in working memory.